WHAT IS CLAIMED IS: 



1. A linear method for performing head motion 
estimation from facial feature data, the method comprising 
the steps of: 

obtaining first facial image and detecting a head 
in said first image; 

detecting position of four points P of said 
first facial image where P = {pi, p 2/ P3/ P4}/ and p* = (x*, 
Yk) ; 

obtaining a second facial image and detecting a 
head in said second image; 

detecting position of four points P' of said 
second facial image where P f = {pj, p 2 , p^jand p' k =(x' k ,y r k )) } 
and, 

determining the motion of the head represented by 
a rotation matrix R and translation vector T using said 
points P and P' . 

2. The linear method of claim 1, wherein said 
four points P of said first facial image and four points P f 
of said second facial image include locations of outer 
corners of each eye and mouth of each respective first and 
second facial image. 

3. The linear method of claim 1, wherein said 
head motion estimation is governed according to: 



US010476 (702498) 



-13- 



P/ = i?P, + T, where R = 

represent camera rotation and translation respectively, 
said head pose estimation being a specific instance of head 
motion estimation. 

4. The linear method of claim 3, wherein said 
head motion estimation is governed according to said 
rotation matrix R, said method further comprising the steps 
of: 

determining rotation matrix R that maps points 
to Fjt for characterizing a head pose, said points 
F l9 F 2 ,F 3 ,F 4 representing three-dimensional (3-D) coordinates of 

the respective four points of a reference, frontal view of 
said facial image , and P k is the three-dimensional (3-D) 

coordinates of an arbitrary point where F i =[X i Y i ZJ r , said 

mapping governed according to the relation: 

i^-P^ll 0 Of 
*(P 6 -P 5 )<*[0 1 Of 

wherein P 5 and P 6 are midpoints of respective line segments 
connecting points PiP 2 and P 3 P 4 and, line segment connecting 
points PiP 2 is orthogonal to a line segment connecting 
points P 5 Pe, and oc indicates a proportionality factor. 

5. The linear method of claim 4, wherein 
components rl, r2 and r3 are computed as: 
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= U and T = [T X T 2 Tj 
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The linear method of claim 5, wherein 



components rl, r2 and r3 are computed as: 
r 3 =(P6-P 5 )x(P2-P,)' 

r 2 = r 3 x(P 2 -P,) 

7. The linear method of claim 4, wherein 

* |~pf 0 r 0 r 1 o o" 

Z o r Pf 0 r 0 1 0 

& 0 r 0 r Pf 0 0 1 

^ each point pair yielding 3 equations, whereby at least four 

PS 

£|i point pairs are necessary to linearly solve for saxd 

}f rotation and translation * 




8. The linear method of claim 7, further 
comprising the step of: decomposing said rotation matrix R 
using Singular Value Decomposition (SVD) to obtain a form R 
= USV T . 



9. The linear method of claim 7, further 
comprising the step of computing a new rotation matrix 

according to R = UV T • 
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10. A linear method for performing head motion 
estimation from facial feature data, the method comprising 
the steps of: 

obtaining image position of four points P* of a 
facial image; 

determining a rotation matrix R that maps points 
Pjc to F k for characterizing a head pose, said points 
F 1? F 2 ,F 3 ,F 4 representing three-dimensional (3-D) coordinates of 

the respective four points of a reference, frontal view of 
said facial image, and P* is the three-dimensional (3-D) 

coordinates of an arbitrary point where ¥ i =[X i Y i ZJ r , said 

mapping governed according to the relation: 

flto-PJoclj 0 Of 
tf(P 6 -P 5 )x[0 1 of 

wherein P 5 and P 6 are midpoints of respective line segments 
connecting points PiP 2 and P 3 P 4 and, line segment connecting 
points PiP 2 is orthogonal to a line segment connecting 
points P 5 P 6 , and oc indicates a proportionality factor. 

11. The linear method of claim 10, wherein 
components rl, r2 and r3 are computed as: 

r 2 r (P 2 "Pi) = 0 
r 3 r (P 2 -P 1 ) = 0 
r 1 r (P 6 -P 5 ) = 0 
r 3 r (P 6 -P 5 ) = 0 
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12. The linear method of claim 11, wherein 
components rl, r2 and r3 are computed as: 
r 3 =(P 6 -P 5 )x(P 2 -P 1 ) / 

r 2 =r 3 x(P 2 ~P 1 ) 
t x =r 2 xr 3 



13. The linear method of claim 12, wherein a 
motion of head points is represented according to P/ = /?P z -l-T 



where R = 



~[ r y] 3 x3 ^presents image rotation, T 2 T 3 J 



represents translation, and P/ denotes a 3-D image position 
of four points P* of another facial image. 



14. The linear method of claim 13, wherein 



P. r 0 r 0 r 1 0 o" 
0 r Pf 0 r 0 1 0 
0 r 0 r P ; r 0 0 1 



= P' 



each point pair yielding 3 equations, whereby at least four 
point pairs are necessary to linearly solve for said 
rotation and translation. 



15. The linear method of claim 14, further 
comprising the step of: decomposing said rotation matrix R 
using Singular Value Decomposition (SVD) to obtain a form R 
- USV T . 
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16. The linear method of claim 15, further 
comprising the step of computing a new rotation matrix 

according to R = UV T . 

17. A program storage device readable by 
machine, tangibly embodying a program of instructions 
executable by the machine to perform method steps for 
performing head motion estimation from facial feature data, 
the method steps comprising: 

obtaining first facial image and detecting a head 
in said first image; 

detecting position of four points P of said 
first facial image where P = {pi, p 2/ p 3/ p 4 }, and = (x k/ 
Yk) ; 

obtaining a second facial image and detecting a 
head in said second image; 

detecting position of four points P' of said 
second facial image where P'^lp^p^p^p^and p' k =(x' k9 y' k )) ; 
and, 

determining the motion of the head represented by 
a rotation matrix R and translation vector T using said 
points P and P ' . 

18. The program storage device readable by 
machine as claimed in claim 17, wherein said four points P 
of said first facial image and four points P 1 of said 
second facial image include locations of outer corners of 
each eye and mouth of each respective first and second 
facial image . 
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19, The program storage device readable by 
machine as claimed in claim 17, wherein said head motion 
estimation is governed according to: 

P/^tfP, +T f where R = 

represent camera rotation and translation respectively, 
said head pose estimation being a specific instance of head 
motion estimation. 

20. The program storage device readable by 
machine as claimed in claim 19, wherein said head pose 
estimation is governed according to said rotation matrix R, 
said method further comprising the steps of: 

determining rotation matrix R that maps points 
to Fjt for characterizing a head pose, said points 
F 15 F 2? F 3 ,F 4 representing three-dimensional (3-D) coordinates of 

the respective four points of a reference, frontal view of 
said facial image , and P k is the three-dimensional (3-D) 

coordinates of an arbitrary point where F i =[X i Y i Z ( ] T , said 

mapping governed according to the relation: 

oc[l o of 
*(P 6 -P 5 )*[0 1 of 

wherein P 5 and P 6 are midpoints of respective line segments 
connecting points PiP 2 and P 3 P 4 and, line segment connecting 
points PiP 2 is orthogonal to a line segment connecting 
points P 5 Pe # and vindicates a proportionality factor. 



=hL and T= [ r i T > T ^ 
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